Samples in many cell-based experiments are matched/paired but taking this into account does not always increase power of statistical tests for differences in means.

Power of statistical tests for differences in means is the probability of obtaining a statistically significant p value when means differ. When samples in experimental replicates come from a single cell culture, they are matched or paired because they share between-trials biological variability. This can cause positive correlation between values from conditions in a replicate. Correlation can also be caused in otherwise independent samples by shared technical variability. However, correlation is reduced by noise that affects samples individually. I investigated how to maximize power in experiments with two conditions over a range of correlations. Normalizing data to control increases the rate of false positives, if Student's t test is used. Paired t tests, theoretically the correct test for matched samples, have higher power than Student's t test when correlation is high, but lower power when correlation is low. Testing correlation to select a test for differences in mean can affect the subsequent rate of false positives. Ultimately, components of experimental variability must be considered to choose the most powerful two sample test for differences in mean. This contrasts with experiments with more than two conditions, where random-block ANOVA, a matched samples test, can be used as a default.

A phenotypic screen for compounds that reverse cAMP-mediated suppression of T cell functions.

The solid tumor microenvironment (TME) suppresses immune responses. Three alterations in the TME converge on a pathway triggered by elevated cyclic AMP (cAMP) that suppresses T cell receptor (TCR) signaling. We developed a phenotypic assay to screen for small molecules that interfere with this pathway using TALL-104 human leukemic cytotoxic T lymphocytes pretreated with prostaglandin E2 to elevate cAMP. Beads coated with anti-CD3 antibodies stimulate lytic granule exocytosis, which is detected via binding of an antibody against lysosome associated membrane protein 1 (LAMP-1) measured with flow cytometry. Confirming that the assay can find compounds with desired activity, treating cells with a phorbol ester restores exocytosis. The assay behaves well in 96-well format and we screened a collection of compounds expected to have effects on epigenetic regulatory proteins. Compounds in this collection affected lytic granule exocytosis after 24-hour treatment, but none prevented cAMP from suppressing lytic granule exocytosis. We used a fully automated 384-well version of the assay to screen the Prestwick Compound Library but obtained no confirmed hits. Analyzing this assay's performance reveals two points of interest. First, cytometry offers multiple ways to quantify signals. Z' was higher using percent positive cells than mean fluorescence because the relationship between the two measures saturates, but using percent positive could make it harder to find hits in some assays. Second, variance was higher in positive controls than in negative controls in this assay, which degrades assay performance less than if variance was higher in negative controls.

Z' Does Not Need to Be > 0.5.

The assay metric Z' has come to play a critical gatekeeping role in determining whether high-throughput assays can be performed. While Z' is commonly required to be > 0.5, this expectation is not well supported. Requiring Z' > 0.5 likely prevents many potentially useful phenotypic and cell-based screens from being conducted, and causes other assays to be conducted under extreme conditions that may prevent activity from being found. We used power analysis and a novel numerical simulation approach to determine how Z' reflects assay performance under a variety of conditions. Our results show that assays with Z' > 0.5 perform better than assays with lower Z', but when an appropriate threshold is selected, assays with Z' < 0.5 can almost always find useful compounds without generating too many false positives. We provide a method that will allow researchers to estimate how to set an appropriate threshold for their assay. We suggest that instead of always requiring Z' > 0.5, assays with Z' < 0.5 should be performed when they can be justified in terms of the importance of the target and the limitations of alternate assay formats.

The National Cancer Institute's Plated Compound Sets Can Be a Valuable Resource for Academic Researchers.

Academic researchers looking for material to screen may benefit from plated compound collections provided at no cost except shipping by the U.S. National Cancer Institute (NCI). Four plated sets are available, two of which comprise diverse synthetic compounds. These collections, of ~900 and ~1500 compounds, are a convenient size to screen without automated equipment, and a great deal of data about the compounds is available that increases their usefulness. Despite these positive attributes, the collections contain a relatively large number of compounds that are pan-assay interfering and nonspecific (PAINS) or may have other chemical liabilities. Our experience with the compound collections suggests that, perhaps because they contain PAINS and other compounds with liabilities, the collections will yield hits in many assays. This makes them a valuable resource for testing primary screens and follow-up workflows, but by the same token means that hits might not be attractive leads for further development. The NCI sets have a great deal of value for academic researchers as a source of material for early screening. It might be possible, however, to create a better collection specifically for this purpose. One possibility is to pool ~5000-10,000 carefully selected lead-like compounds into ~1000 wells. A collection like this might also generate hits in a wide variety of assays but avoid the downside of those hits often having liabilities.

Temperature-Dependent Expression of a CFP-YFP FRET Diacylglycerol Sensor Enables Multiple-Read Screening for Compounds That Affect C1 Domains.

Intramolecular CFP-YFP fluorescence resonance energy transfer (FRET) sensors expressed in cells are powerful research tools but have seen relatively little use in screening. We exploited the discovery that the expression of a CFP-YFP FRET diacylglycerol sensor (DAGR) increases over time when cells are incubated at room temperature to assess requirements for robust measurements using a Molecular Devices Spectramax i3x fluorescence plate reader. Expression levels resulting in YFP fluorescence >10-fold higher than untransfected cells and phorbol ester-stimulated FRET ratio changes of 60% or more were required to consistently give robust Z' > 0.5. As a means of confirming that these conditions are suitable for screening, we developed a novel multiple-read protocol to assay the NCI's Mechanistic Set III for agonists and antagonists of C1 domain activation. Sixteen compounds prevented C1 domain translocation. However, none blocked phorbol ester-stimulated protein kinase C (PKC) activity assessed using a phospho-specific antibody-six actually stimulated PKC activity. Cytometry, which produces higher Z' for a given FRET ratio change, might have been a better approach for discovering antagonists, as it would have allowed lower phorbol ester concentrations to be used. We conclude that CFP-YFP FRET measured in a Spectramax i3x plate reader can be used for screening under the conditions we defined. Our strategy of varying expression level and FRET ratio could be useful to others for determining conditions needed for robust cell-based intramolecular CFP-YFP FRET measurements on their instrumentation.

Post-Glycosylation Diversification (PGD): An Approach for Assembling Collections of Glycosylated Small Molecules.

Many small molecule natural products with antibiotic and antiproliferative activity are adorned with a carbohydrate residue as part of their molecular structure. The carbohydrate moiety can act to mediate key interactions with the target, attenuate physicochemical properties, or both. Facile incorporation of a carbohydrate group on de novo small molecules would enable these valuable properties to be leveraged in the evaluation of focused compound libraries. While there is no universal way to incorporate a sugar on small molecule libraries, techniques such as glycorandomization and neoglycorandomization have made signification headway toward this goal. Here, we report a new approach for the synthesis of glycosylated small molecule libraries. It puts the glycosylation early in the synthesis of library compounds. Functionalized aglycones subsequently participate in chemoselective diversification reactions distal to the carbohydrate. As a proof-of-concept, we prepared several desosaminyl glycosides from only a few starting glycosides, using click cycloadditions, acylations, and Suzuki couplings as diversification reactions. New compounds were then characterized for their inhibition of bacterial protein translation, bacterial growth, and in a T-cell activation assay.

A Novel Multiple-Read Screen for Metabolically Active Compounds Based on a Genetically Encoded FRET Sensor for ATP.

Both glycolysis and mitochondrial energetics are targets of interest for developing antiproliferative cancer therapeutics. We developed a novel multiple-read assay based on long-term expression in K562 cells of a genetically encoded intramolecular Förster resonance energy transfer sensor for adenosine triphosphate (ATP). The assay, conducted in a fluorescent plate reader, can identify compounds that inhibit oxidative phosphorylation-dependent ATP production, glycolysis, or both after short-term treatment. We screened a National Cancer Institute (NCI) compound library, identifying inhibitors of oxidative phosphorylation-dependent ATP production and glycolysis. Three glycolysis inhibitors blocked hexokinase activity, demonstrating that our assay can serve as the initial step in a workflow to identify compounds that inhibit glycolysis via a defined desired mechanism. Finally, upon reviewing the literature, we found surprisingly little evidence that inhibiting glycolysis with small molecules is antiproliferative. Using NCI data on proliferation of K562 cells, we found that inhibitors of oxidative phosphorylation-dependent ATP production were no more antiproliferative than the overall library, whereas all glycolysis inhibitors were in the top third of most effective antiproliferative compounds. Our results thus present a powerful new way to screen for compounds that affect cellular metabolism and also provide important support for the idea that blocking glycosis is antiproliferative.

A Multiplexed Assay That Monitors Effects of Multiple Compound Treatment Times Reveals Candidate Immune-Enhancing Compounds.

We previously developed a flow cytometry assay that monitored lytic granule exocytosis in cytotoxic T lymphocytes stimulated by contacting beads coated with activating anti-CD3 antibodies. That assay was multiplexed in that responses of cells that did or did not receive the activating stimulus were distinguished via changes in light scatter accompanying binding of cells to beads, allowing us to discriminate compounds that activate responses on their own from compounds that enhance responses in cells that received the activating stimulus, all within a single sample. Here we add a second dimension of multiplexing by developing means to assess in a single sample the effects of treating cells with test compounds for different times. Bar-coding cells before adding them to test wells lets us determine compound treatment time while also monitoring activation status and response amplitude at the point of interrogation. This multiplexed assay is suitable for screening 96-well plates. We used it to screen compounds from the National Cancer Institute, identifying several compounds that enhance anti-LAMP1 responses. Multiple-treatment-time (MTT) screening enabled by bar-coding and read via high-throughput flow cytometry may be a generally useful method for facilitating the discovery of compounds of interest.

Synthesis and biological evaluation of santacruzamate A analogues for anti-proliferative and immunomodulatory activity.

Santacruzamate A (SCA) is a natural product isolated from a Panamanian marine cyanobacterium, previously reported to have potent and selective histone deacetylase (HDAC) activity. To optimize the enzymatic and cellular activity, 40 SCA analogues were synthesized in a systematic exploration of the zinc-binding group (ZBG), cap terminus, and linker region. Two cap group analogues inhibited proliferation of MCF-7 breast cancer cells, with analogous increased degranulation of cytotoxic T cells (CTLs), while one cap group analogue reduced CTL degranulation, indicative of suppression of the immune response. Additional testing of these analogues resulted in reevaluation of the previously reported SCA mechanism of action. These analogues and the resulting structure-activity relationships will be of interest for future studies on cell proliferation and immune modulation.

Metallothionein regulates intracellular zinc signaling during CD4(+) T cell activation.

BACKGROUND: The ultra-low redox potential and zinc binding properties of the intracellular pool of mammalian metallothioneins (MT) suggest a role for MT in the transduction of redox signals into intracellular zinc signals. Increased expression of MT after exposure to heavy metals, oxidative stress, or inflammatory cytokines leads to an increased intracellular redox-mobilizable zinc pool that can affect downstream zinc-sensitive signaling pathways. CD4(+) T helper cells are poised to be influenced by MT transduced zinc signaling because they produce intracellular reactive oxygen species following activation through the T cell receptor and are sensitive to small changes in intracellular [Zn(2+)]. RESULTS: MT expression and intracellular [Zn(2+)] are both increased during primary activation and expansion of naïve CD4(+) T cells into the Tr1 phenotype in vitro. When Tr1 cells from wildtype mice are compared with congenic mice lacking functional Mt1 and Mt2 genes, the expression of intracellular MT is associated with a greater increase in intracellular [Zn(2+)] immediately following exposure to reactive oxygen species or upon restimulation through the T cell receptor. The release of Zn(2+) from MT is associated with a greater increase in p38 MAPK activation following restimulation and decreased p38 MAPK activation in MT knockout Tr1 cells can be rescued by increasing intracellular [Zn(2+)]. Additionally, IL-10 secretion is increased in MT knockout Tr1 cells compared with wildtype controls and this increase is prevented when the intracellular [Zn(2+)] is increased experimentally. CONCLUSIONS: Differences in zinc signaling associated with MT expression appear to be a result of preferential oxidation of MT and concomitant release of Zn(2+). Although zinc is released from many proteins following oxidation, release is greater when the cell contains an intracellular pool of MT. By expressing MT in response to certain environmental conditions, CD4(+) T cells are able to more efficiently release intracellular zinc and regulate signaling pathways following stimulation. The link between MT expression and increased zinc signaling following activation represents an important immunomodulatory mechanism of MT and illuminates the complex role MT plays in shaping immune responses.

Development of an Enhanced Phenotypic Screen of Cytotoxic T-Lymphocyte Lytic Granule Exocytosis Suitable for Use with Synthetic Compound and Natural Product Collections.

We previously developed an assay of cytotoxic T-lymphocyte lytic granule exocytosis based on externalization of LAMP-1/CD107A using nonphysiological stimuli to generate maximal levels of exocytosis. Here, we used polystyrene beads coated with anti-CD3 antibodies to stimulate cells. Light scatter let us distinguish cells that contacted beads from cells that had not, allowing comparison of signaling events and exocytosis from stimulated and unstimulated cells in one sample. Bead stimulation resulted in submaximal exocytosis, making it possible to detect compounds that either augment or inhibit lytic granule exocytosis. Coupled with the assay's ability to distinguish responses in cells that have and have not contacted a stimulatory bead, it is possible to detect three kinds of compounds: inhibitors, stimulators, which cause exocytosis, and augmenters, which enhance receptor-stimulated exocytosis. To validate the assay, we screened a set of synthetic compounds identified using our previous assay and a library of 320 extracts prepared from tunicate-associated bacteria. One of the extracts augmented exocytosis threefold. Activity-guided fractionation and structure elucidation revealed that this compound is the known PKC activator teleocidin A-1. We conclude that our modified assay is suitable for screening synthetic compound plates and natural product collections, and will be useful for identifying immunologically active small molecules.

Flow Cytometry Enables Multiplexed Measurements of Genetically Encoded Intramolecular FRET Sensors Suitable for Screening.

Genetically encoded sensors based on intramolecular FRET between CFP and YFP are used extensively in cell biology research. Flow cytometry has been shown to offer a means to measure CFP-YFP FRET; we suspected it would provide a unique way to conduct multiplexed measurements from cells expressing different FRET sensors, which is difficult to do with microscopy, and that this could be used for screening. We confirmed that flow cytometry accurately measures FRET signals using cells transiently transfected with an ERK activity reporter, comparing responses measured with imaging and cytometry. We created polyclonal long-term transfectant lines, each expressing a different intramolecular FRET sensor, and devised a way to bar-code four distinct populations of cells. We demonstrated the feasibility of multiplexed measurements and determined that robust multiplexed measurements can be conducted in plate format. To validate the suitability of the method for screening, we measured responses from a plate of bacterial extracts that in unrelated experiments we had determined contained the protein kinase C (PKC)-activating compound teleocidin A-1. The multiplexed assay correctly identifying the teleocidin A-1-containing well. We propose that multiplexed cytometric FRET measurements will be useful for analyzing cellular function and for screening compound collections.

A high-throughput phenotypic screen of cytotoxic T lymphocyte lytic granule exocytosis reveals candidate immunosuppressants.

We screened the National Institutes of Health's Molecular Libraries Small Molecule Repository for inhibitors of cytotoxic T lymphocyte (CTL) lytic granule exocytosis by measuring binding of an antibody in the extracellular solution to a lysosomal membrane protein (LAMP-1) that is transferred to the plasma membrane by exocytosis. We used TALL-104 human leukemic CTLs stimulated with soluble chemicals. Using high-throughput cluster cytometry to screen 364,202 compounds in a 1536-well plate format, we identified 2404 initial hits: 161 were confirmed on retesting, and dose-response measurements were performed. Seventy-five of those compounds were obtained, and 48 were confirmed active. Experiments were conducted to determine the molecular mechanism of action (MMOA) of the active compounds. Fifteen blocked increases in intracellular calcium >50%. Seven blocked phosphorylation of extracellular signal-regulated kinase (ERK) by upstream mitogen-activated protein kinase kinases >50%. One completely blocked the activity of the calcium-dependent phosphatase calcineurin. None blocked ERK catalytic activity. Eight blocked more than one pathway. For 8 compounds, we were unable to determine an MMOA. The activity of 1 of these compounds was confirmed from powder resupply. We conclude that a screen based on antibody binding to CTLs is a good means of identifying novel candidate immunosuppressants with either known or unknown MMOAs.

Flow cytometry enables a high-throughput homogeneous fluorescent antibody-binding assay for cytotoxic T cell lytic granule exocytosis.

We developed a homogeneous phenotypic fluorescence end-point assay for cytotoxic T lymphocyte lytic granule exocytosis. This flow cytometric assay measures binding of an antibody to a luminal epitope of a lysosomal membrane protein (LAMP-1) that is exposed by exocytosis to the extracellular solution. Washing to remove unbound antibody is not required. Confirming the assay's ability to detect novel active compounds, we screened at a concentration of 50 µM a synthetic diversity library of 91 compounds in a 96-well plate format, identifying 17 compounds that blocked by 90% or more. The actions of six structurally related tetracyano-hexahydroisoindole compounds that inhibited by ~90% at a concentration of 10 µM were investigated further. Four reduced elevations in intracellular Ca(2+); it is likely that depolarization of the cells' membrane potential underlies the effect for at least two of the compounds. Another compound was found to be a potent inhibitor of the activation of the mitogen-activated protein (MAP) kinase ERK. Finally, we transferred the assay to a 384-well format and screened the Prestwick Compound Library using high-throughput flow cytometry. Our results indicate that our assay will likely be a useful means of screening libraries for novel compounds with important biological activities.

Calcium influx and signaling in cytotoxic T-lymphocyte lytic granule exocytosis.

Cytotoxic T lymphocytes (CTLs) kill targets by releasing cytotoxic agents from lytic granules. Killing is a multi-step process. The CTL adheres to a target, allowing its T-cell receptors to recognize antigen. This triggers a signal transduction cascade that leads to the polarization of the microtubule cytoskeleton and granules towards the target, followed by exocytosis that occurs specifically at the site of contact. As with cytokine production by helper T cells (Th cells), target cell killing is absolutely dependent on Ca2+ influx, which is involved in regulating both reorientation and release. Current evidence suggests that Ca2+ influx in CTLs, as in Th cells, occurs via depletion-activated channels. The molecules that couple increases in Ca2+ to reorientation are unknown. The Ca2+/calmodulin-dependent phosphatase calcineurin, which plays a critical role in cytokine production by Th cells, is also involved in lytic granule exocytosis, although the relevant substrates remain to be identified and calcineurin activation is only one Ca2+-dependent step involved. There are thus striking similarities and important differences between Ca2+ signals in Th cells and CTLs, illustrating how cells can use similar signal transduction pathways to generate different functional outcomes.

No specific subcellular localization of protein kinase C is required for cytotoxic T cell granule exocytosis.

Cytotoxic T cells kill virus-infected cells and tumor cells by releasing lytic granules that contain cell-killing contents. Exocytosis requires calcium influx and protein kinase C (PKC) activation. Here, we extend our previous finding regarding the lack of isoform specificity of PKCs in the granule release step, showing that mutant constitutively active PKCdelta can substitute for phorbol esters and support exocytosis. PKCdelta, a novel PKC isoform, was recently shown to play a role in lytic granule reorientation. Surprisingly, however, our results suggested that mutant PKCdelta did not localize to the plasma membrane (PM). To test directly whether PKC has to be in the PM to drive exocytosis, we generated mutants of various PKC isoforms that were tethered either to the outer mitochondrial membrane or to the PM. Tethered mutant PKCdeltas were able to promote exocytosis as effectively as the untethered version. The substrates of PKCs involved in lytic granule exocytosis are currently unknown, but subcellular localization is believed to be a critical factor in determining PKC accessibility to substrates. That there is no requirement for specific PKC localization in lytic granule exocytosis may have important implications for the identity of PKC substrates.

Calcineurin-dependent lytic granule exocytosis in NK-92 natural killer cells.

Cytotoxic T cells (CTLs) and natural killer cells (NKs) both kill virus-infected cells and tumor cells by releasing the cytoxic contents of their lytic granules. We recently demonstrated a role for calcineurin in lytic granule exocytosis in TALL-104 human leukemic CTLs [M.J. Grybko, J.P. Bartnik, G.A. Wurth, A.T. Pores-Fernando, A. Zweifach, Calcineurin activation is only one calcium-dependent step in cytotoxic T lymphocyte granule exocytosis, J. Biol. Chem. 282 (2007) 18009-18017]. However, whether calcineurin plays a similar role in NK lytic granule release is not known. We tested whether calcineurin is involved in lytic granule exocytosis in human leukemic NK-92 cells using immunosuppressive drugs that block calcineurin function and by overexpressing a constitutively active calcineurin fusion protein. Our results indicate that calcineurin does play a role in lytic granule exocytosis in NK-92 cells, and suggest that, as was the case in TALL-104 cells, there are likely to be multiple calcium-dependent steps.

ERK activation is only one role of PKC in TCR-independent cytotoxic T cell granule exocytosis.

Cytotoxic T cells (CTLs) kill target cells by releasing lytic agents via regulated exocytosis. Three signals are known to be required for exocytosis: an increase in intracellular Ca(2+), activation of protein kinase C (PKC) and activation of extracellular signal regulated signal kinase (ERK). ERK activation required for exocytosis depends on activity of PKC. The simplest possibility is that the sole effect of PKC required for exocytosis is ERK activation. Testing this requires dissociating ERK and PKC activation. We did this using TCR-independent stimulation of TALL-104 human leukemic CTLs. When cells are stimulated with thapsigargin and PMA, agents that increase intracellular Ca(2+) and activate PKC, respectively, PKC-dependent ERK activation is required for lytic granule exocytosis. Expressing a constitutively active mutant MAP kinase kinase activates ERK independent of PKC. However, activating ERK without PKC does not support lytic granule exocytosis, indicating that there are multiple effects of PKC required for granule exocytosis.

Calcineurin activation is only one calcium-dependent step in cytotoxic T lymphocyte granule exocytosis.

We have tested the idea that calcineurin, a calcium-dependent phosphatase that is critical for activating cytokine gene expression in helper T cells, plays a role in lytic granule exocytosis in cytotoxic T lymphocytes (CTLs). We used TALL-104 human leukemic CTLs as a model. Our results confirm an earlier report (Dutz, J. P., Fruman, D. A., Burakoff, S. J., and Bierer, B. E. (1993) J. Immunol. 150, 2591-2598) that immunosuppressive drugs inhibit exocytosis in CTLs stimulated either via the T cell receptor (TCR) or via TCR-independent soluble agents. Of the two recently reported alternate targets of immunosuppressive drugs (Matsuda, S., Shibasaki, F., Takehana, K., Mori, H., Nishida, E., and Koyasu, S. (2000) EMBO Rep. 1, 428-434 and Matsuda, S., and Koyasu, S. (2000) Immunopharmacology 47, 119-125), JNK is not required for lytic granule exocytosis, but we were not able to exclude a role for P38. Exocytosis could be inhibited by expressing GFP fused to a C-terminal fragment of CAIN (cabin 1), but not by expressing VIVIT-GFP. Finally, expressing either full-length or truncated constitutively active mutant calcineurin A enhanced lytic granule exocytosis. However, the mutant calcineurin was unable to support exocytosis when cells were stimulated in the absence of Ca2+ influx. Taken together, our results support the idea that activation of calcineurin is required for lytic granule exocytosis but suggest that it is not the sole Ca2+-dependent step.